NUSC  Tachnieat  ftaporl  644S 
12  March  1981 


' , '  1/  * 

Lcjji  L: 


Statistics  of  Noniineariy 
Transformed  Coherence  Estimates 


Albert  H.  Nuttall 

Surface  Ship  Sonar  Department 


^  JUL  8  1981 ' 


^aval  Underwater  Systems  Center 

SNevnport,  Rtiode  Island/New  London,  Connecticut 


>  Apfroaad  tar  puMIe  ralaaaa;  dtalrtauttan  unHmHad. 


Preface 


This  research  was  conducted  under  NUSC  IRIED  Project  No.  A75205,  Sub- 
project  No.  ZROOOOIOI,  Applications  of  Statistical  Communication  Theory  to 
Acoustic  Signal  Processing,  Principal  Investigator  Dr.  A.  H.  Nuttall  (Code  3302), 
Program  Manager  CAPT  David  F.  Parrish,  Naval  Material  Command  (MAT  08L). 

The  Technical  Reviewer  for  this  report  was  Dr.  G.  C.  Carter  (Code  3331). 


Reviewed  and  Approved:  12  March  1981 


W.  Von  Winkle 
Associate  Technical  Director  for  Technology 


The  auihor  of  this  report  is  located  at  the 
New  London  Laboratory,  Naval  Underwater  Systems  Center, 
New  London,  Connecticut  06320 


REPORT  DOCUMENTATION  PAGE 


agPQRT number 


^<^-TR~6445 


Pkr.P  READ  INSTRUCTIONS 

_ ] _ BEFORE  COMPLETING  FORM 

'|2.  SOVT  accession  no.  3.  RECIPIENT'S  CATAU30  NUMBCR 


5.  TYPE  OP  PEPOPT  »  PEPIOO  COVERED 


#/VTlSTICS  OF  NONLINEARLY  TRANSFORMED  COHERENCE 
TIMATES  0  ^  ^ 


6.  PERPOPMINS  OPG.  REPORT  NUMBER 


17.  authors  j; 


Albert  H./Nuttall 


S.  cos  tract  OP  GRANT  NUMBEPf*; 


?  Tt&cA  yi/Cd)  /  /-i 


9.  PERPOPminG  organization  name  anO  ADDRESS 

Naval  Underwater  Systems  Center 

New  London  Laboratory 

New  London,  Connecticut  06320 _ 

II.  CONTROLLING  OFPICE  NAME  ANO  ADDRESS 

Naval  Material  Command  (MAT  08L)  C 
Washington,  DC  20362  W 


10.  , program  element,  project,  TASK 
AREA  *  «0RK  unit  numbers 


REPORT  OATS 

1  12  March  1981 

IS.  number^-p-paoes 

37 


l«  monitoring  agency  name  »  ADORESScn  dlllartnt  /ram  Cotitrolling  Olllcm)  IS.  SECURITY  CLASS,  (ol  ihit  raport; 

UNCLASSIFIED 


IS*.  DECL  ASSI  FI  CATION/ OOWNGRAOING 

schedule 


I  IS.  OISTRiauTtON  statement  /j/  thlt  Rdpanj 


Approved  for  public  release;  distribution  unlimited. 


'Tt^  Distribution  statement  /<>/  IA#  tbtiraet  mtand  m  atoek  20.  11  dlllmtul  tram  Raport) 


IS.  supplementary  notes 


I  IS.  KEY  WORDS  /ConUnu*  on  roworoo  oldo  H  noooomorr  and  tdonitfy  by  btoek  nimbor) 


Asymptotic  Expansion 
Bias 

Coherence 

Coherence  Estimation 


Mean  Square  Error 

Moments 

Statistics 

Non linearly  Transformed 


Variance 


^ACT  fConcimi*  on  fovoro 


•arr  ontf  fdmntifr  dr  dl9ck  numbmt) 


^  An  asymptotic  relation  for  the  average  value  of  any  nonlinear  transformation  of 
a  magnitude-squared-coherence  estimate  is  derived.  It  is  utilized  to  determine 
the  bias,  variance,  and  mean-squpre  error  of  the  transformed  coherence  estimate. 
It  is  found  that  the  arc  tanh  (x'^)  transformation  is  the  only  one  with  variance 
independent  of  the  true  coherence  value  to  0(N"^),  and  that  the  ln(x)  trans¬ 
formation  is  the  only  one  with  zero  bias,  to  exponential  order  in  N.  Here,  N  is 
the  number  of  data  pieces  employed  in  the  estimation  of  the  coherence.  Exten- 
sions  to  terms  of  0(N~^1  are  made  and  presented  for  a  v-th  law  device  also.  .> —  i 


FORM 
I  JAN  73 


edition  of  I  NOV  <9  IS  OBSOLETE 
S/N  0  10  J-0  14-  SSO  I 


If 

;  / 

^ 


TR  6445 


Table  of  Conlenis 


List  of  Symbols .  ii 

liiiroduciioii  .  1 

Esiimaiioii  of  Mauiiiludc-Sqiiared  Cohoroncc .  2 

AveragL'  Vahio  of  T raiisrormcd  Coherence  Estimate .  3 

Alternative  Forms  for  Aserage  Value  .  3 

First-order  approximations .  5 

Second-order  approximations  .  7 

Variance  of  T ransl'ormed  Coherence  Estimate  .  13 

Mean  Square  Error  of  T ransrormed  Coherence  Estimate  .  16 

Discussion  and  Summary  .  18 

Appetidix  A  -  Asymptotic  Development  of  First  Two  Moments  .  A-1 

Appendix  B  -  Asymptotic  Development  of  n-th  Moment  .  B-1 

Appendix  C  -  Modified  Approximations  for  Average  Value .  C-1 

Appendix  D  -  Statistics  of  Logarithmic  Transformation .  D-1 

Appendix  E  -  Modified  Forms  for  Variance  .  E-1 

Appendix  F  -  Location  of  Peak  of  Probability  Density  Function  .  F-1 


References 


R-1 


List  of  Symbols 


0(x) 

N 

C 

t 

MSC 

MC 

g(6,  g(x) 
p(x) 

E 

A 

''n 

B 

Q 

V 

s 


order  of  x 

number  of  data  pieces  used  in  coherence  estimate 
true  value  of  magnitude-squared  coherence 
estimate  of  C 

magnitude-squared  coherence 
magnitude  coherence 

output  of  nonlinear  transformation  of  d,  x 
probability  density  function  of  t 
ensemble  average 

average  output  of  nonlinear  transformation 

n-th  moment  of  ^  about  C 

bias  at  output  of  nonlinear  transformation 

mean-square  output  of  nonlinear  transformation 

variance  of  output  of  nonlinear  transformation 

mean-square  error  at  output  of  nonlinear  transformation 


II 


r 


I  k  6445 


STATISTICS  OF  NONLINEARLY  TRANSFORMED 
COHERENCE  ESTIMATES 


INTRODUCTION 


Previous  rcsulis  on  ilic  siaiisties  of  the  magniliido-squared-cohercnee  (MSC) 
esliinaic  C'  and  ilic  magnitude-coherence  (MC)  estimate  ^  have  required  sim- 
plilieaiion  ol  h> pergeometrie  I'unetions  ,F.,.  sometimes  with  great  labor  (reCerenees 
1-4).  This  el  lori  has  been  reiiuired  because  of  the  paucity  of  asymptotic  results  for 
the  ,l  ■,  funeiion.  in  reference  4,  this  shortcoming  was  partially  alleviated  by 
deriving  asvmptotie  results  for  the  MSC  estimate,  and  doing  curve-fitting  for  the 
MC  esiimaie.  iher<'bv  obtaining  relatively  simple  relations  for  the  bias,  variance, 
and  mean-square  error  in  these  two  eases. 

Hi  vsover,  whenever  a  different  nonlinear  transformation  of  the  MSC  estimate  is 
considered,  the  anaivtieal  elTort  must  begin  anew  to  determine  the  fundamental 
behavior  of  the  >tatisties  such  as  moments.  For  example,  in  reference  5,  the  non¬ 
linear  translormation  are  tanh  )  of  MSC  estimate  was  shown  to  yield  a  nearly- 
Claiissian  random  variable,  thereby  facilitating  calculation  of  eonfidence  limits  for 
eonerci’ce  detectors.  However,  the  mean  and  variance  of  the  nearly  Gaussian 
'.andont  variable  were  deduced  by  a  linic-consuming  trial-and-error  curve-fitting 
procedure. 

Here,  we  will  rectify  this  sisaation  by  deriving  simple  asymptotic  relations,  for 
large  N,  for  the  statistics  of  any  nonlinear  transformation  of  C,  where  N  is  the 
number  of  data  pieces  employed  in  the  estimation  of  coherence  (reference  6).  In  this 
fashion,  we  can  determine  the  fundamental  behavior  of  statistics  like  the  bias, 
variance,  and  mean-square  error  for  a  particular  distortion  of  without  an  undue 
amount  of  labor.  Also,  we  can  deduce  new  nonlinear  transformations  with  desirable 
behavior. 
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KSTIMATION  OF  MAGNITUDE-SQUARED  COHERENC  E 

The  eoniplcx  eolioiLMicc  bcivsoen  t\vo  joinily-siaiiDiiary  random  processes  \(t)  and 
v(i)  is  defined  as 

G  (f) 

,  (f)  .  -r - ^  . 

IV"'  “yy'«]  0, 

where  Ci,^(f)  is  ihe  eross-speetral  density  at  frequency  f,  and  G^^(f)  and  C\Jf)  are 
llie  aulo-speeiral  ticnsities.  The  MSC  is 


C(f)  =  lY^y(f) 


The  MSC  is  frequently  estimated  according  to  (reference  6) 


C(f)  H 


|G  (f) 
'  xy 


E  \m  v;(f) 

n=i 


“xx'«  =yy'«  2  E  1^ 

^  n=l  "  n=l  " 


where  N  is  the  number  of  data  segments  employed,  and  X|,(f),  Y„(0  are  the 
(discrete)  Fourier  transforms  of  the  n-th  wfcighted  data  segments  of  x(i)  and  y(t). 

The  statistics  of  a  nonlinearly  transformed  version  g(^  of  MSC  estimate  t  are  of 
interest  here.  We  drop  frequency  dependence  f  henceforth,  for  notational  sim¬ 
plicity;  thus  C  is  the  true  (unknow'n)  value  of  MSC  that  we  are  estimating. 


I  U  (>445 


AVKRAGF  V ALU K  OF  TRANSFORMEO  COHERENCE  ESTIMATE 

The  probabiliiy  densiiy  I'lmelion  of  MSC  csiinuue  ^is  given  by  referenee  1 ,  eq.  (2) 
el  seq..  as 


p(x)  =  (N  -  1) 


(1  -  0(1  -  X)  1^-2 

''l  +  Cx\ 

1  -  Cx  ‘^N-l  \ 

L  J 

1  -  CxJ 

for  O^x^l,  0<C<1 


(4) 


where  Pv;,,  is  a  Legendre  polynomial.  II' ^is  siibjeeted  to  nonlinear  iransl'ormaiion 
g(C  ),  the  average  value  of  the  oiiipui  is 

A  =  E{g(C)}  =  f  dx  p(x)  g(x)  , 

•'0  (5) 


For  large  N,  probability  density  p(\)  is  peaked  aboiii*  \  =  C;  see  referenee  1, 
figures  la-lh.  Aceordingly,  the  major  contribution  to  (5)  will  come  from  this 
neighborhood,  so  we  expand  transformation  g  about  this  point: 


n=0 


-  C)"  .  i  i  8'">  (C)  V, 


n*0 


’  (6) 


where 

,1 

\  =  J  dx  p(x)  (x  -  O" 
0 

is  the  n-th  moment  of  estimated  about  true  value  C. 


(7) 


An  expression  for  general  moment  is  given  in  referenee  4,  page  2,  along 

with  speeifie  simpler  results,  for  m  =  1  and  2,  in  terms  of  the  Gauss  hypergeometrie 
function  ,F,.  In  appendix  A  here,  v,  and  v,  are  developed  in  an  asymptotic  ex¬ 
pansion  through  order  N  -;  in  appendix  B,  the  dominant  behavior  of  v,,  is  developed 
for  all  integer  n.  The  results  are 


-  (1  -  C)‘ 


2C(1  -  C)‘ 


(8) 


-  2C(1  -  C)“ 
2  ■  N 


2(1  -  C)^  (1 


.  0(N-^j 


N 


(9) 


•For  (■  =  I,  p(\)  =  d(\-l ).  ulivrciis  lor  C  =  0.  pis)  (N-l  )l l-x)’'*  -.  W  o  cscliiUc  iticsc  aiypical  vases  Ironi 
considcralioii  here.  These  probahiliiv  deiisiis  tiineiioiis  lor  ('  =  I  and  C  -  U  are  snilieienils  simple  ihai 
ihes  ean  be  insesiiealed  separalels . 
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/  n.'  -  C)^ 


V  ^ 

n 


(n/2) 


for  n  even 


nJ 


n.'  C 


(1  -  O"  [l  -f  C  >  n(l  -  5C)1 


(¥)• " 


2 


for  n  odd 


as  N  ^  ; 

C  >  0  . 

(10) 


In  pariicular,  ii  is  scon  that  v,  and  v-,  arc  0(N  ‘),  v,  and  arc  0(N  -),  and  tor  n>5 
is()(N  ')  or  smaller. 

C  ombining  these  results  in  (6),  sve  obtain  tor  the  average  value  of  the  device 
output: 

2 

A  =  g(C)  +  ‘  [g'  (C)  ^  Cg"(C)] 

2 

+  Lk  -  C.L  r2cg'  (C)  +  (1  -  6C  +  7ch  g"(c) 

N 

+  2C(1  -  0(1  -  2C)  g"'(0  +|-C^(1  -  C)^  g”"(C)]  +  OCN'^J. 

(ID 

This  result  gives  the  fundamental  dependence  on  N,  C,  and  transformation  g. 
Through  0(N-'),  we  need  to  evaluate  the  nonlinear  function  and  its  first  two 
derivatives,  but  to  be  correct  to  OfN  -).  it  is  necessary  to  evaluate  up  through  the 
fourth  derivative  of  the  nonlinear  function. 

The  bias  at  the  output  of  the  nonlinear  device  is  defined  as 

B  =  E{g(C)}  -  g(C)  =  A  -  g(C)  , 


and  is  given  by  the  terms  after  g(C)  in  (11).  It  is  generally  of  0(N  ');  this  will  be 
elaborated  on  later. 

A  particular  example  of  the  application  of  (II)  is  afforded  by  transformation 
g(x)  =  X.  Then  the  device  output  is  just  the  MSC  estimate,  and  (12)  yields  bias 


B 


(1  -  C)  2C(1  -  O' 


N 


0(N'h 


N‘ 


(13) 


in  agreement  with  reference  4,  eq.  (8). 
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ALTERINATIVK  FORMS  FOR  AVKRA(;K  VALUE 
First-Order  Approximations 

Lot  us  retain  only  the  terms  ihrouiili  ()(N  ')in(M)aii<J  12);  then 

2 

A  ~  g(C)  >  [g'  (C)  *  Cg'(C)]  as  N  ^  »  , 


and 


B 


[fe  (C) 


Cg"(C)] 


as  N  ->■  “ 


(14) 


(15) 


Now  we  approximate  the  right-hand  side  ol'  (14)  by  the  quantity 


>1  =  8(c  ♦ 


(16) 


w  hieh  can  be  developed  as 

Aj  -  g(C3  +  ^  g  (C)  as  N  ^  CO 


(17) 


and  we  choose  a(C)  so  that  (14)  and  (17)  match  as  N  becomes  large.  There  follows 
the  approximation  to  the  average. 


(18) 


The  bias  approximation  follows  from  (12)  and  (18)  as 


B 


1 


(19) 


Forms  (18)  and  (19)  turn  out  to  be  more  useful  than  (14)  and  (15),  respeetively,  in 
some  cases.  For  the  MSC  estimate  itself,  g(x)  =  x,  and  the  results  yielded  by  (18)  and 
( 19)  are  identical  to  (14)  and  (15),  respectively. 

For  the  MC  estimate  &  ,  we  have 
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,  ,  1/2  ^  1  -1/2  .  1  -3/2 

g(x)  =  X  '  ,  g  (x)  =  -j  X  ,  g  (x)  X 


riicn  ilic  ci|iiaiii)ns  abo\c  yickl 
A 


ci/2  ,  a  -  O- 


4NC 


ITT 


as  N  -►  <» 


(20) 


(21) 


N = (c. 


B  ~  as  N  -*■  oo  , 


4NC 


1/2 


^  ^  -T 


1/2 


-  C 


1/2 


(22) 


(23) 


(24) 


Whereas  (21)  and  (23)  blow  up  as  C-»0.  (22)  and  (24)  remain  finije.  In  I'aci,  (24)  is 
precisely  ihe  result  obtained  by  curve-fitting  in  reference  4,  page  (20).  eqs.  (39)  and 
(33).  toO(N-'). 


This  is  a  fortuitous  situation  for  approximations  (22)  and  (24).  In  the  derivations 
above,  it  was  presumed  that  transformation  g(x)  could  be  well  approximated  in 
terms  of  a  few  derivatives  at  x  =  C  and  that  OO.  These  conditions  arc  obviously 
violated  for  MC  device  (20)  as  C-*0;  nevertheless,  forms  (22)  and  (24)  are  still 
reasonable  in  this  limit.  This  situation  will  arise  for  other  nonlinear  transformations 
considered  below.  The  basic  problem  is  that  (21)  is  not  a  uniform  asymptotic  ex¬ 
pansion  with  respect  to  C  (reference  7,  chapter  9);  it  holds  as  N-"*®.  for  fixed  OO. 


For  the  transformation  yielding  a  nearly  Gaussian  random  variable,  discussed  in 
the  Introduction  and  studied  in  reference  5,  we  have 

1/2,  .  1 


g(x)  =  arc  tanh(x  '  ),  g'{x)  = 


2x^^^(l  -  X) 


g  (x)  = 


3x 


..  3/2,,  ,2 

4x  (1  -  x) 


(25) 


Application  of  (14).  (15).  (18).  and  (19)  yields 


A  ~  arc  tanh(C^^^)  +  ^  *iJp  as  N  -*•  « 

4NC  ' 


(26) 


I 

I 
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A 


1 


=  arc  tanh 


(27) 


B 


1  -t- 

4.;c 


_c 

1/2 


as  N  “ 


(28) 


B 


1 


arc  tanh 


arc  tanh(C) 


(29) 


Result  (27)  agrees  with  relereiiee  5,  eqs.  (7)  and  (8).  which  was  ohiained  onl>  after 
considerable  trial  and  error  and  curve-fitting.  Again,  the  apprciviiiiatioiis  (27)  and 
(29)  are  better  behaved  than  their  progenitors  (26)  and  (28)^which  blow  up  as  C-*-0. 
As  above,  (26)  is  not  a  uniform  asymptotic  expansion  w  ith  respect  to  C. 

Finally,  let  us  inquire  into  what  nonlinear  transformation  would  yield  ^ero  bias, 
to()(N').  Equation  ( 15)  indicates  that  tite  only  such  device  must  satisfy 

^  (Cg' (C) }  =  0  .  (30) 

That  is,  the  logarithmic  transformation 


g(x)  =  a  ln(x)  +  b 


(31) 


has  zero  bias,  for  any  constants  a  and  b,  to  0(N  '). 


Sec<»nd-Order  Appniximathin.s 

We  now  retain  terms  through  0(N  -)  in  the  average  (II)  and  represent  it  by 
shorthand  notation; 


»  .  g,c)  . 

^  N 


as  N  ->■  “> 


(32) 


We  now  want  to  fit  this  asymptotic  expansion  by  the  approximation 


to  ()(N  -).  Accordingly  we  develop  (33)  as 


(33) 


-  g(C)  +  g  (C) 


/a(C) 

V  N 


b(C)\ 


2  8 


(C) 


a^(C) 


as  N 


(34) 
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C  omparison  of  (32)  and  (34)  \  ii.'lds 


a(C) 


a(C) 

g'  CC) 


.  b(C) 


g(C)  _  g"(C)  a^(C) 
g'(C)  2[g'(C)]^ 


whore  I'roni  (II),  we  already  know 

a(C)  =  (1  -  C)^  [g'  (C)  -r  Cg"(C)]  . 

e(C)  =  (1  -  C)^  [2Cg'(C)  +  (1  -  6C  -r  7C^)  g"(C) 

+  2C(1  -  C)  (1  -  2C)  g’"(C)  ^  -  C)^  g"(C)] 


(35) 


(36) 


Equation  (33),  together  with  (35)  and  (36).  goes  the  seeond-order  approximation  to 
the  average  value.  The  result  lor  a(C  )  m  (35)  is  ideiiiieal  to  that  obtained  earlier  in 
(18);  tliat  lor  b(C')  is  quite  involved  aiid  requires  a  speeilie  iranslormation  for 
simplirieation. 

Tlie  results  for  bias  are  now  obtained  by  eombming  (12)  and  (32). 


— 


6(C) 


as  N 


(37) 


and  by  eombining  (12)  and  (33), 


B 


1 


^  a(C)  ^  b(C)\ 
^  ) 


-  g(C) 


(38) 


Thus  our  general  results  to  0(N  -)  are  given  by  (32),  (33),  (37),  and  (38),  where  the 
various  parameters  are  given  in  (35)  and  (36).  Now  vve  apply  these  results  to  speeifie 
examples. 

For  the  MSC  estimate  itself. 

g(x)  =  X  ,  g' (x)  =  1,  g'(x)  =  g"(x)  =  g"'tx)  =  0  . 


and  there  follows 
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This  Iasi  rclaiion  has  already  been  timed  in  (13). 
lor  I  he  Mt'  esiimaie,  we  have 

g(x)  =  g  (x)  =  i  ,  g"(x)  =-  j 


g"(x)  =  Jx-^/2  g*-(x)  =-^x-^/2 

T'ciiiatioii  (36)  f  ields 

(1  -  C)^  ,  (1  -  C)^  (1  +  3C)^ 

® - ’ 

and  (35)  yields 


(41) 


(42) 


a  = 


-  (1  -  c)' 


b  = 


(1  -  C)^  (1  +  2C  +  5C^) 
8C 


(43) 


Then  (32)  and  (33)  yield,  for  the  results  on  the  average  value  for  the  MC  esimtuie, 


_i/2  ^  (1  -  cr  ^  (1 


C)^  (1  •>•  3C)^ 


as  N 


(44) 


.(c. 


(1  -  c)‘ 

2N 


(1  -  C)"  (1 


2C 


♦  5C^) 


8N  C 


(45) 


wliile  (37)  and  (38)  give  the  corresponding  results  on  bias;  namely,  subtract  C 
from  each  of  the  expressions  in  (44)  and  (45). 

We  now  observe  the  disconcerting  result  that  inclusion  of  the  ()(N  -)  term  in 
approximation  (45)  blows  up  at  C  =  0,  whereas  the  0(N  ’)  term  does  not.  This 
suggests  that,  for  small  C,  whereas  approximation  A,  in  (16)  was  well-suited  to  the 
available  information  to  0(N-'  ),  there  is  a  more  suitable  approximation  than  A,  in 
(33)  when  0(N  -)  information  is  available  on  the  average  value;  this  possibility  is 
taken  up  in  appendix  C.  Basically,  the  fact  that  (44)  is  not  a  uniform  asymptotic 
expansion,  with  respect  to  C,  is  causing  this  singularity  at  C  =0.  However,  (44)  and 
(45)  yield  very  good  approximations  for  large  N  and  OO. 


For  the  arc  tanh  (x  )  transformation,  we  augment  (25)  with  the  two  additional 
terms 

2 

T 


III,  3  -  lOx  +  ISx"  if»r,  ^  3(35x^  -  35x^  +  21x  -  5) 

8  =  ~T72 - T"  ’8  ^  - 772 - : - 

8x^'^(l  -  x)'^  16x'^^(l  -  x) 


(46) 
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Tile'll  f  rom  (36), 


1  +  C  „  _  (1  +  C)  (1  +  6C  +  C  ) 


and  from  (35) 


„  _  1  -  _  (1  -  C^)  (1  +  2C  -  C^) 

a - ^  .  b - ^ - 


Tlio  a\  cragc  oiiipiii  can  iun\  bo  obtained  from  (32)  and  (33)  in  the  forms 


.  e  1  +  C  (1  +  C)  (1  +  6C  +  C  ) 

A  ~  arc  tanh  (C  '  )  +  - rj!j  *  - -  y  ,,, - -  as  N  -»■  »  , 

4NC^'^  32rC'^^^  (49, 


A,  .  arc  taahifc  .  .  (1  -  (1  ♦  2C  -  C^) 


Since  arc  tanh  (x  •)  ~  x  as  x-*0,  the  same  behavior  regarding  the  blowup  at  C  =  0 
of  the  0(N--)  term  is  expected  and  present,  just  as  for  the  MC  estimate  relations  in 
(44)  and  (45).  The  bias  of  the  are  tanh  (x'  )  transformation  is  obtained  by  siib- 
traeting  arc  tanh  (C  )  from  both  forms  in  (49)  and  (50).  A  modification  of  ap¬ 
proximation  (50),  better  suited  to  small  C,  is  developed  in  appendix  C. 

For  the  logarithmic  transformation  of  the  MSC  estimate,  we  have 
g(x)  =  In(x),  g'  (x)  =  x"\  g''(x)  =  -x"^, 

g  (x)  =  2x  ,  g  (x)  =  -6x  . 

Equation  (36)  yields  the  surprising  result 


a  =  0  ,  6=0, 


for  which  (35)  immediately  gives 


a  =  0  ,  b  =  0 


Thus  both  (32)  and  (33)  yield  for  the  average  value  of  the  device  output 


A  ~  A2  =  ln(C)  +  0(N'  )  . 


Thus  the  unbiased  character  of  the  logarithmic  distortion  holds  to  at  least  0(N  -), 
not  just  0(N  ')  as  claimed  originally  in  (30)  and  (3 1 ).  This  behavior  in  (54)  holds  of 
course  for  OO,  as  noted  earlier. 


10 


TR  6445 


In  appendix  D,  ihe  average  value  of  the  ln(\)  transformation  is  derived  exaetly;  it 
is  given  hy 


(55) 

By  eonipleiing  the  summation  to  infinity,  and  then  subiraeting  this  added  quantity, 
we  can  svrite  (55)  as 

CO 

A  =  ln(C)  +  Y.  -  -  for  C  >  0  , 

n=N  "  (56) 


N-1 

=  -L 

n=l 


(1  -  cy 


for  all  C  and  N 


which  has  no  approximations  whatsoever.  The  summation  in  (56)  is  the  bias  and  can 
be  upper-bounded  by 


B  < 


(1  -  C)‘ 
NC 


exp(N  ln(l  -  C) ) 
NC 


for  C  >  0 


(57) 


Thus  the  decay  of  the  bias  is  exponential  in  N  for  fixed  OO.  This  explains  why  the 
coefficients  of  N-i  and  N-^  were  zero  in  (53);  in  fact,  all  coefficients  of  would  be 
zero  for  k^l. 

We  should  also  observe  (reference  8,  eqs.  6.3.2  and  6.3.18)  that  average 


A 


ln(C)  >  ■  for  C  >  0 

-Y  -  ln(N)  +  -^  +  — ^  for  C  =  0 
2N 


as  N  -*■  “> 


(58) 


Thus  as  the  number  of  pieces,  N,  used  in  the  MSC  estimate  increases,  the  average  A 
saturates  at  ln(C)  for  C#(),  but  gets  arbitrarily  negative  for  C  =0.  This  is  due  to  the 
singularity  of  the  transformation  ln(x)  at  \  =  0. 

The  last  nonlinear  transformation  we  consider  is  the  v-th  law  device: 

g(x)  =  x'’,  g^"^(x)  =  (v  +  1  -  n)  x'^""  . 

(59A) 


Substitution  in  (35)  and  (36)  yields,  after  simplification, 

2.  ,2  v-1 

a  =  V  (1  -  C)  C  , 

6  =  j  v^{l  -  C)^  [1  -  V  +  (1  +  v)  C]^  . 


and 
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a  =  v(l  -  C)^  , 

2 

b  =  2c— ■  ^  -  C)  (1  +  301  ,  ,(^oj 

respectively.  The  average  output  of  the  v-th  law  device  is  then  available  upon 
substitution  of  (60)  in  (32)  or  (33).  These  results  reduce  to  (40)  for  v=  1,  and  to  (42) 
through  (45)  forv=  1/2.  It  can  be  seen  from  (60)  that  the  only  case  where  b  does  not 
tend  to  infinity,  as  C  tends  to  zero,  is  for  v  =  I,  the  MSC  estimate.  All  other  cases  do 
not  yield  a  uniform  asymptotic  expansion  in  powers  of  N  ',  with  respect  to  C.  A 
modification  of  (60)  to  circumvent  the  singularity  at  C  =  0  is  presented  in  appendix 
C. 
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VARIANCE  OF  TRANSFORMED  COHERENCE  ESTIMATE 

In  order  lo  deiermine  the  variance  of  the  transformed  coherence  estimate,  we 
need  to  be  able  to  evaluate,  in  addition  to  (5),  the  average 


1  1 

Q  =  E{g^(C)}  =  f  dx  p(x)  g^(x)  =  r  dx  p(x)  q(x)  , 

-'o  •'0 


(61) 


w  here  we  have  defined 


q(x)  =  g^(x)  . 


(62) 


But  now  we  can  use  average  output  (1 1)  on  (61).  with  a  re-identification  of  g  in  (M) 
as  q  here.  So  we  need  the  quantities  (using  an  obvious  shorthand  notation) 

q  =  ,  q  =  2gg  .  q  =  2gg  +  2g  g  ,  q  =  2gg  +  6g  g  , 


=  2gg  +  8g  g  +  6g  g 


(63) 


where  all  these  functions  are  evaluated  at  C.  There  follows  from  (11), 

^  , .  .  .  \ ^  r 1  n'  ^ 

Q  =  g  + 


_  _2  2(1  -  C)  r _ /•  .  /  ,  (1  -  C)  f  > 

=  "  ^  -  [gg  +  Cgg  +  Cg  g  J  +  -i - [4Cgg 


N 


2(1  -  6C  +  7^)  (gg"  +  g'g') 

+  4C(1  -  C)  (1  -  2C)  (gg'"+  3g'g") 


+  C^(l  -  C)^  (gg""  +  4g' g'"  +  3g"g")]  +  0(N 


(64) 


The  variance  of  the  device  output  is  then 


V  =  Q  -  A 


(65) 


Substitution  of  (1 1)  (as  is)  and  (64)  in  (65)  and  cancellation  of  a  number  of  similar 
terms  yield  the  desired  result  for  the  variance  of  the  device  output : 

V  =  g'  g'  *  [g'  g'  (1  -  IOC  +  13C^) 

*  g'g''2C(l  -  C)  (5  -  IIC)  +  g"g"2C^(l  -  C)^ 


+  g'g'"  4C  (1  -  C)  ]  +  0(N'  ) 


(66) 


Here  g  '  =  g  '(C),  g  "  =  g  '  '(C),  g  "'  =  g  "  '(C).  We  observe,  that  to  0(N''),  only  the 
first  derivative,  g  (C),  is  required  for  the  variance;  recall  that  to  0(N  '),  the 
average,  (11),  required  g  '  '(C)  in  addition.  Also  g  " '  '(C)  does  not  enter  (66),  at  least 
through  0(N  2). 
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The  lirsi  example  we  apply  (66)  to  is  the  MSC  estimate,  g(x)  =  x.  There  follows 
immediately 

V  =  -  C)^  ^  (1  -  C)^  (1  -  IOC  ^  13C^)^ 

^  (67) 

This  result  agrees  with  referenee  4,  eq.  9,  to  0(N--)  when  the  latter  is  expanded  in 
powers  of  N 

Next  consider  the  MC  estimate  as  given  in  (41 ).  Employment  in  (66)  results  in 

V  =  ■  [1  +  2C  -  IIC^]  +  0(N'^)  . 

8N^C  (68) 


The  first  term  in  (68)  agrees  with  that  in  referenee  4,  eq.  (33),  to  0(N-').  The  second 
terms  do  not  agree,  due  mainly  to  the  C  '  dependence  in  (68);  that  is,  once  again, 
(68)  is  not  a  uniform  asymptotic  expansion  with  respect  to  C.  A  modification  to  the 
singular  contribution  is  considered  in  appendix  E;  the  result  is  given  by  (E-2): 


V  = 


(1  -  c)^  (1  -  era  -  30 


2N 


2N 


(69) 


This  modification  for  the  variance  of  the  MC  estimate  agrees  precisely  with  the 
terms  through  0(N‘-)  of  reference  4,  eq.  (33),  when  the  latter  is  developed  in  a 
power  series  in  N*'. 

The  pertinent  equations  for  the  arc  tanh  (x  '  =)  transformation  are  presented  in  (25) 
and  (46).  Their  use  in  (66)  for  the  variance  yields 


V  = 


1 

2N 


8N  C 


(70) 


Tha!  is,  to  0(N  ■),  the  variance  of  the  arc  tanh  (x'  )  output  is  independent  of  the 
true  value,  C,  of  the  MSC.  This  result  has  been  noted  and  utilized  before;  see 
reference  9  and  reference  5,  eq.  (9).  Furthermore,  from  (66),  it  may  be  seen  that  the 
only  device  with  variance  independent  of  C,  to  0(N'’),  is  in  fact  q,  arc  tanh  (x  )  + 
q,,  where  q,  and  q,  are  constants. 

A  modification  to  (70)  is  derived  in  (E-3)  and  (E-4),  namely. 


(71) 


That  is,  the  modification  indicates  a  variance  independent  of  the  true  value  C  of  the 
MSC,  through  0(N'’). 


For  the  logarithmic  transformation,  we  substitute  (5 1 )  in  (66)  and  obtain 
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V  = 


2(1  -  C)‘ 
NC 


(1  -  cr  (1  ^  c)‘ 

2  2 
N  C 


+  0(N  ) 


(72) 


Here,  even  ihe  0(N  ')  lerm  lends  to  infinity  as  C-*0;  this  is  due  to  the  singularity  of 
the  ln(\)  transformation  at  \  =  0.  Evaluation  of  the  mean  square  value  and  varianee 
of  the  deviee  output  is  eondueted  in  appendix  D;  in  partieular,  for  the  anomalous 
situation  at  C  =  0  in  (72),  we  find  theexaei  result  (D-)7); 


N-1  , 

V  =  53  for  C  =  0  . 

k=l  k 


Asymptotically  this  behaves  as  (D-18): 

2 

V  =  V  -  M  -  0(N"  )  for  C  =  0 

6  N 


(73) 


(74) 


Thus,  whereas  the  variance  of  the  logarithmic  device  output  tends  to  zero  as  N-»<»  if 
OO,  according  to  (12),  the  variance  stabilizes  at  Tt-/6  as  N-*oo  for  C  =  0.  This 
means  that  increasing  the  number  of  pieces,  N,  employed  in  the  MSC  estimate  will 
not  help  in  reducing  the  fluctuations  at  the  device  output  if  C  =  0.  However,  it 
should  be  recalled  from  (58)  that  the  average  device  output  becomes  arbitrarily  large 
negatively  in  the  case  of  C  =0;  thus  the  ratio  of  standard  deviation  to  average  value 
does  decrease  to  zero  as  N-*oo,  for  C=0  as  well  as  for  OO.  This  particular 
behavior  of'the  ln(x)  transformation  is  due  to  the  logarithmic  singularity  at  x  =  0. 

For  the  v-th  law  device,  we  employ  (59)  in  (66)  and  find 


V  = 


2v~(l  -  C)^ 
N 


2,  ,2  p2v-2  _ 

+  ^  ^ -  [(1  +  c)^  -6v(l  +  C)  (1  -  C) 

N 


+  6v^(l  -  C)^]  +  0(N"^)  . 


(75) 


For  v  =  1,  this  reduces  to  (67),  while  for  v=  '/;,  it  becomes  (68).  A  modification  to 
the  singular  component  of  (75)  at  C  =0  (for  v<  1)  is  obtained  in  (E-6): 


2(1  -  3v(l  -  C))] 

N  J  •  (76) 

For  v=  this  reduces  to  (69).  The  variance  approximation  (76)  is  not  singular  at 
C  =0,  provided  that  v  > 


V  = 


2v^(l  -  C)^ 
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MKAN  SQCJARK  KRROR  OF 
TRANSFORMED  COHERENCE  ESTIMATE 


The  desired  output  of  the  nonlinear  transformation  is  the  non-random  eonsiant 
g(C).  However,  the  aetual  output  is  g(^ ).  We  theuefore  form  an  average  squared 
error  as 


S  ;  E{[g(C)  -  g(C)]%  . 


(77) 


But  this  ean  be  expressed  in  terms  of  previously  evaluated  quantities  aeeording  to 
S  =  E{[g(C)  -  E{g(C)}  +  E{g(C)}  -  g(C)l^} 


=  E{[g(C)  -  E{g(C)}]^}  +  (E{g(C)}  -  g(C)l^  =  V  +  . 

(78) 

where  the  cross-produet  term  averages  to  zero.  When  we  use  the  results  of  (1 1),  (12), 
and  (66),  (78)  yields  the  general  result  for  the  mean  square  error: 


S  = 


_  2C(1  -  C) 


(1  -  C)‘ 


^  ^ ^  l2g’gXl  .  6C  +  7C‘) 


+  12gg"C(l  -  C)  (1  -  2C)  +  3g  g  C"(l  -  C)‘ 
+  4gg''c^(l  -  0^1  +  0(N‘^)  . 


179) 


For  the  MSC  estimate  itself,  g(x)  =  x,  and  (79)  yields 


^  .  2C(1  -  C)2  2(1  -  (1  -  6C  +  7C^)  ^,..-3, 

^ - N -  - 7 -  J 

N 


(80) 


in  agreement  with  reference  4,  eq.  (12),  when  the  latter  is  expanded  in  powers  of 
N 


For  the  MC  estimate,  g(x)  =  x '  ■  ,  and  there  follows 


S  = 


(1  -  O"  (1  -  C)‘(l  +  6C 

"  ■  16A 


i5£!l  .  0(N-’) 


For  the  are  tanh  (x  )  device,  use  of  (25)  and  (46)  in  (79)  leads  to 


(81) 
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1  1  -  14C  +  C 

S  =  ^ - 2 -  +  0(N  )  . 

16rc  (82) 

To  0(N  '),  ihe  mean  square  error  is  independent  of  the  true  value,  C,  of  the  MSC. 
For  the  logarithmie  transformation,  (79)  gives 


c.  _  2(1  -  C)^  .  (1  -  C)^  (1  ^  C)^  . 


NC 


2  2 
N  C 


0(N'-")  . 


(83) 


This  equals  variance  (72),  of  course,  since  the  bias  is  zero  to  all  orders  N  '^,  as  shown 
in  (57). 

Finally,  the  v-th  law  device  g(x)  =  \''  yields,  with  the  help  of  (79), 


2v^(l  -  C)^  .  v^(l  -  C)^ 

N  ^2 


((1  +  C)^  -  6v(l  +  C)  (1  -  C)  +  7v^(l  -  C)^]  +  0(n‘^)  . 


(84) 


Forv=  1,  this  specializes  to  (80),  while  for  v=  it  becomes  (81). 
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DISCUSSION  AND  SUMMARY 

Asymptotic  expressions  for  the  average  value,  bias,  variance,  and  mean  square- 
error  of  the  output  of  a  nonlinear  transformation  have  been  derived,  to  0(N  -). 
Extensions  to  higher  moments  of  the  device  output  are  easily  accomplished  by 
interpreting  q  in  (61)  as  the  appropriate  moment  of  g,  as  was  done  in  (62)  for  the 
second  moment.  For  example,  we  could  evaluate  the  third  cumulant  of  g(^  )  in  this 
fashion. 

The  modifications  adopted  here  to  attempt  to  alleviate  the  singular  behavior  at 
C  =  0  of  (he  terms  of  0(N--),  for  the  are  lanh  (x  -)  and  v-th  law  devices,  are 
recognized  to  be  incorrect.  The  reason  for  the  seemingly  anomalous  behavior  is  that 
the  results  here  are  not  uniform  asymptotic  expansions  with  respect  to  C.  The 
proper  way  to  handle  these  cases  is  to  derive  the  appropriate  uniform  asymptotic- 
expansions.  However,  this  would  likely  be  a  time-consuming  and  tedious  task;  the 
methods  of  reference  7,  chapter  9,  would  be  very  relevant  in  this  regard. 

It  is  now  a  simple  matter  to  evaluate  the  statistics  of  any  additional  candidates  for 
MSC  estimate  transformation,  such  as  -In  (1-x),  -(1-x)'',  -arc  tanh  ((1-x)  ),  for 
example.  These  devices  are  not  necessarily  suggested  for  actual  use,  but  rather  arc- 
obvious  modifications  of  the  ones  considered  here:  they  have  been  chosen  to  be 
monotonically  increasing  over  (0,  I ). 


1 
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Appendix  A 

Asymptotic  Development  of  First  Two  Moments 

From  (7),  the  n-th  moment  of  Mahout  C  is 

1 

=  J  dx  p(x)(x  -  C)"  . 

0 

Of  course  =  I ,  and  v,  =  p,  -  C,  where  moment 


=  /  dx  p(x)  x" 


0 

We  now  employ  reference  4,  eq.  (5)  to  obtain 


(A-I) 


(A-2) 


"'l  =  ^  1;  N  ^  2;  C) 


(A-3) 


At  this  point,  we  expand  all  the  terms  in  (A-3)  to  0(N--);  there  follows 

*  s  •  (i  -  R')(i  -  ^ '  ;7)  ■:  (>  *  rrr  •  ottwitt) 


+  OCN"-") 


q)! .  o(N-^) 

N 


(A -4) 


after  simplification.  Also  p,  =  C  +  v,  gives  p,  to  0(N'-). 
For  n  =  2,  (A-l)  and  (A-2)  yield 

2 

V2  =  M2  '  2CMj  +  C 


(A-5) 


An  expression  for  pj  is  given  in  reference  4,  eq.  (6);  we  develop  it  in  like  fashion  to 
(A-4): 


M2  =  -N  +  2N 


-  ^  •  N  •  ('  -  li)  (‘  -  i  *  ^2  -  ^3  *  J4) 


'(N^  -  NC  +  2C)  F  +  0(N'^)  , 


(A-6) 


A-l 
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where 


F  =  1  + 


2C 


N  +  2  (N  +  2)(N  +  3) 


^  _ 6cf _  240"^  nrM-5-, 

(N  +  2)(N  +  3)(N  +  4)  ■"  4 

N 


(A-7) 


We  must  keep  terms  to  OCN-*)  to  counter  the  N-  terms  in  {A-6).  Substitution  of(A-7) 
in  (A-6),  expansion  of  all  the  products,  and  retention  of  the  highest  orders  yields, 
after  considerable  manipulation. 


,2  .  4C(1  -  ,  2(1  -  0^(1 

N  ~T~ 


N 


(A-8) 


Finally,  substitution  of  (A-8)  and  (A-4)  in  (A-5)  yields 


2C(1  -  C)^  2(1  -  C)^  (1  -  6C  +  7C^)  -3 

V. - -  +  - 2 -  +  0(N  3  .  (^.9) 

N 


N 


Although  continuation  of  the  procedure  above  to  higher  moments  such  as  and 
^4  (and  thence  Vj  and  V4)  is  possible,  it  is  extremely  tedious  and  error  prone.  A  useful 
asymptotic  development  of  (A-1)  is  proferred  in  appendix  B. 
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Appendix  B 

Asymptotic  Development  of  n-th  Moment 


The  n-ih  moment  of  interest  is  given  by  (7), 

1 

=  /  dx  p(x)(x  -  O"  .  jg 

0 

while  p(\)  is  given  by  (4).  For  large  N,  the  probability  density  p(x)  peaks  in  the 
neighborhood  of  \  =  C.  To  see  this,  we  use  the  asymptotic  expansion  of  the 
Legendre  polynomial  given  in  reference  10,  page  194,  eq.  8.21 .1 : 


'’.w 


(y  . 

—  ..I 


m+1/2 


as  m 


1) 


1/4 


for  y  >  1 


(B-2) 


We  now  identify  m  =  N-1  and  y  =  (l  +Cx)/(1-Cx):  then  (B-2)  and  (4)  yield 


P(x) 


(N  -  1)^^^  (1  -  C)^  (1  -  X) 
2.^/2  (Cx)'/^  (1 


N-2 


as  N  -*■  » 


for  Cx  >  0  . 

(B-3) 


The  function  (l-x)/(l-  peaks  at  x  =  C;  raising  it  to  a  power  sharpens  this 

peak.  The  exact  location  of  this  peak  to  0(N-')  is  considered  in  appendix  F.  Sub¬ 
stitution  of  (B-3)  in  (B-1)  yields 


V 

n 


C)‘ 


2.1/2  cV4 


J  dx(x 


n  1  -  _  1  -  X 

xl/^lfl  -  x)2  (l  -  x/^)2 


as  N  , 
for  C  >  0  , 


(B-4) 


where  the  integration  can  be  confined  to  the  neighborhood  of  the  peak  of  the 
bracketed  function  at  x  =  C. 


The  general  problem  is  now  to  determine  the  asymptotic  behavior  of  the  integral 
I  E  f  dx(x  -  O"  f(x)  [0(x)]^ 

as  N-*<»,  where  the  integration  is  confined  to  the  neighborhood  of  the  peak  of  <|)(x) 
at  x  =  C.  This  problem  is  undertaken  later  in  this  appendix;  here  we  shall  merely 
make  the  identifications  and  evaluate  the  required  parameters.  We  use  only  the 
dominant  term  in  that  asymptotic  expansion: 


B-l 
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1  -  ,  ,  ,  1  -  X 

1/4  2  ’  4>(^)  -  ,  ; 

X  ^  (1  -  x)^  (l  -^/^ 


h  -  f  -  1  u  .  f  .  7C  -  1 

°  °  -  C)  ’  ^  ^  4C^/'*(1  -  C)^ 


<*>0  =  r-Tc  *  ° 


-1  ,  3(1  -  3C) 

3  »  ^Pt  -  2  4 


2C(1  -  C) 


4C(1  -  C) 


4C  (1  -  C) 


2  •  ^3  '  _2 


1  -  3C 


8C  (1  -  O' 


j  +  l)  4C(1  -  C)^  for  n  odd. 


The  result  for  integral  1  in  (B-5)  then  becomes 


(^)[ 


4C(1  -  O^J  ^ 


for  n  even 


(1  .  C)^  N  C^/^(l  -  C) 


r(y  +  l)  [4c  (l  -  C)^]^  [1  +  C  +  n(l  -  30] 


for  n  odd 


(1  -  O^  (1  -  C)^ 


as  N  -►  »  , 


for  C  >  0 


Substitution  in  (B-4)  and  simplification  lead  to 


n!  (1  -  O” 

(n/2)! 


for  n  even 


n!  C  ^  (1  -  O”  [1  •*•  C  -»•  n(l  -  3C )] 


for  n  odd 


as  N  -*■  ® 
for  C  >  0 
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This  is  the  desired  general  result;  particular  values  are 

,  j  (1  -  C)^  2C(1  -  C)^ 

~  ^ - N -  *  ^2 - N - 


12C(1  -  0^(1  -  2C)  12C^(1  -  C)^ 

2  »  ^4 - 2 - 


60C^(1  -  0^(3  -  7C)  120C^fl  -  C)^ 

^3  -'-e - - 


as  N  ,  for  C  >  0. 


Asymptotic  Development  of  I 

The  integral  of  interest  is  given  in  (B-5).  where  f(C)  0  and  where  n  is  an  integer. 
<ti(x)  has  a  maximum  at  the  point  C  w  hich  is  interior  to  the  range  of  integration.  We 
shall  use  and  extend  the  procedure  given  in  reference  1 1,  pages  272-274,  to  develop 
the  asymptotic  expansion.  We  also  limit  the  derivation  here  to  the  case  of  n  even; 
the  extension  to  n  odd  is  presented  without  derivation. 

Let  A  =  X  -  C  and 

<p(x)  ~  i  i  (|)jA^  +  i  as  A  0 


where 


Also  let 


=  <^Jl  *  P2  A^  *  P3A2  +  P4  A^]  , 


-  xftn)  ^ 

=  <t)  (C)  ,  p  = 

in  mm;? 


f(x)  f  +  f  A  +  i  f  A^  as  A  0 
o  1  2:2 


(B-10) 


(B-Ii) 


where 


=  b  +  b  A  b-A 
o  I  2 


f  E  (C).  b  =  . 

m  m  m : 


(B-12) 


(B-13) 


Substitution  in  (B-5)  yields 


I 

L 
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2  3  4 

+  p^A  +  p^A  +  p^A 


I  ~  J  dA  A^^b^  +  A  +  (})^  exp^N  ln(l 

~  <))q  /  dA  A"^b^  +  b^A  +  b^A^'j  exp^N  ^p^A^  +  p^A^  +  p^A^*  -  p^A‘^/2jj 

=  4>o  /  dA  a"  ^b^  +  bjA  +  ^2^^)  ('^  I P2 1 

,  exp^NPjA^)  exp^N(|p^  -  p2/2^A'‘j  , 


where  we  utilized  the  fact  that  p  2  <  0  since  ^(x)  peaks  at  x  =  C. 


(B-14) 


Now  let  t  =  A/N'  in  (B-14)  and  defineq  =  (n+l)/2;  then 


_  ^  J  dt  dxp(^-tp,|t2)  ^  (bjt  ♦  b^Pjd) 


'rs 


P2/2J  *  ®3^o*^3  ® 

as  N  00  ,  for  n  even. 


‘"4] 

(B-15) 


where 


(q). 


(m  -  1)  : 


q  = 


n  +  1 


for  n  even 


(B-16) 


The  procedure  for  n  odd  is  exactly  as  above,  except  that  ^(x)  and  f(x)  must  be 
expanded  to  one  higher  order  than  in  (B-10)  and  (B-12).  All  other  symbols  arc  as 
defined  above,  except  that  now 


B-4 
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q  = 


for  n  odd  . 


(B-17) 


There  follows  for  (B-5), 


I 


♦o  '■^‘1'  r 

r 


1  o  3 


^3^2) 


"  "  ^2^)(P4  - 


^4 ^0*^3  ^3^1  *^3  ^2^2^3 


as  N  ,  for  n  odd. 

(B-18) 


The  desired  asympiotie  expansion  of  integral  (B-5)  is  given  by  (B-15)  and  (B-18) 
for  large  N,  where  N  need  not  be  an  integer.  In  deriving  (B-7)  and  (B-8)  earlier,  we 
only  used  the  dominant  or  leading  term  of  (B-15)  and  (B-18).  Extension  of  (B-7)  and 
(B-8)  to  the  next  term  would  require  consideration  of  the  correction  terms  in  (B-15) 
and  (B-18). 

For  n  =  0,  the  leading  term  of  (B-15)  reduces  to  reference  7,  pages  211-212,  eq. 
5.6.21.  Thus  we  have  generalized  here  to  nonzero  n,  both  even  and  odd,  and  to  the 
first  correction  term. 


B-5/B-6 
Reverse  Blank 


TR  6445 


Appendix  C 

Modified  Approximations  For  Average  Value 

The  approximation  A,  developed  for  the  average  of  the  MC  estimate  in  (45)  tends 
to  infinity  as  C-*0.  That  is,  the  b(C)  term,  (43),  which  is  used  in  approximation  (33), 
blows  up  at  C  =0.  In  order  to  rectify  this  situation,  we  reconsider  the  coefficients 

(1  -  C)^  (1  -  C)“(l  +  2C  +  5C^) 

^  2  '  8C  •  (C-1) 

Both  a  and  b  have  the  common  factor  (l-C)-;  this  was  also  true  for  the  MSC  results 
in  (40).  Keeping  this  factor,  we  rewrite  b  in  (C-1 )  as 

(1  -  C)^[(l  -  C)^  *  4C(1  ^  C)] 

°  ■  8C 

(1  -  (1  -  C)^(l  +  C) 

=  - 8C -  *  - 2 -  •  (C-2) 

The  lead  term  in  (C-2)  has  a  fourth-order  zero  at  C=  1,  and  a  smaller  scale  factor; 
therefore  its  neglect  would  not  significantly  affect  the  value  of  (C-2)  for  moderate 
C.  Also  this  term  contains  all  of  the  singularity  at  C  =  0.  Moreover,  since  (45)  is  an 
approximation  to  an  asymptotic  expansion  which  is  not  uniform  with  respect  to  C,  a 
reasonable  modification  to  (C-2)  is  to  drop  the  singularity  while  trying  to  realize  as 
little  effect  on  larger  C  values  as  possible.  Accordingly  we  adopt  modified  coef¬ 
ficient 

r  _  (1  -  0^(1  ^  C) 

b  >  _ _ 


thereby  realizing  the  modified  approximation  to  (45)  for  the  MC  estimate, 

I  (1. -.0^(1 

^  \  2N^  )  (C-4) 

This  result  agrees  precisely  to  0(N-2)  with  reference  4,  eqs.  (39)  and  (33),  when  the 
latter  are  expanded  in  a  power  series  in  N-';  observe  that  D  =  0(N-2)  there. 

Notice  that  we  have  modified  the  approximation  (45),  but  not  the  asymptotic- 
expansion  (44):  we  must  accept  the  asymptotic  expansion  as  it  is,  since  it  is  the 
unique  expansion  in  powers  of  N  '  for  this  problem.  But  we  can  do  what  we  please 
with  an  approximation. 

For  the  arc  tanh  (x '  -)  transformation,  coefficients  a  and  b  are  given  by  (48)  as 


a 


h  (l  -  C^)(l  *  2Z  -  C^) 
8C 


(C-5) 


C-1 
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We  regroup  the  terms  in  b  (keeping  the  eommon  faetor  1-C-  present  in  both  terms) 
so  as  to  minimize  the  efteel  for  larger  C: 

b  =  -  [(1  -  C)^  +  2C(2  -  o] 

=  (1  ^  C)(l  -  C)^  (l  -  C^)(2  -  C)  ^C-6) 

8C  4 

The  modified  eoefficient  is  obtained  by  dropping  the  singular  term: 

h  -  (l  -  C^)(2  -  C) 

4  •  (C-7) 


The  modified  approximation  for  the  average  value  is  then 

1  -  (l  -  C^)  (2  - 


A  =  arc  tanhllC  + 


2N 


4N 


1 


(C-8) 


This  is  an  extension  of  reference  5,  eqs.  (7)  and  (8). 

For  the  v-th  law  device  considered  in  (58),  the  coefficients  are  repeated  from  (60): 

a  =  v(l  -  C)^  ,  b  =  [(1  -  v)  -  2(1  -  v)C  +  (1  +  3v)C^J  . 

(C-9) 


Again,  regrouping  the  terms  in  b,  and  keeping  the  common  factor  ( 1  -C)^,  we  obtain 

2 

b  =  [(1  -  v)(l  -  C)^  +  4C(1  -  V  +  vC)] 

^  -  Cj_  ^  2v(I  -  C)^  (1  -  V  +  vC)  ,  (C-IO) 

where  the  singular  factor  has  the  fourth-power  of  (1-C).  The  modified  coefficient 
follows  as 


b  =  2v(l  -  C)“  (1  -  V  >  vC) 


(C-11) 


(This  reduces  to  (C-3)  for  v~  For  v=  1,  the  lead  term  in  (C-10)  is  already  zero, 
and  (C-10)  equals  (40).)  The  modified  approximation  for  the  average  value  of  the 
output  of  the  v-th  law  device  is 


.(c- 


v(i  -  cy 

N 


2v(l  -  C)  (1 


V  + 


An  approximation  to  the  bias  is  afforded  by  subtracting  C*'  from  (C-12). 


(C-12) 


C-2 
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Appendix  D 


Statistics  of  Logarithmic  Transformation 


Average  Value 

According  to  (5),  the  average  value  of  the  output  of  the  logarithmic  trans¬ 
formation  is  given  by 


dx  p{x)  In  X 


(D-1) 


Instead  of  using  (4)  for  the  probability  dcnsitv,  we  use  reference  1 ,  cq.  (3): 


dx  (N  -  1)(1  -  (1  -  F(N,  N;  1;  Cx)  In  x 


n 


=  (N  -  i)(i  -  c)^  Z 


kto  ^^^k  ^^^k  ■() 


dx(l  -  x)^”^  X  ^  In  X 
(D-2) 


We  now  use  reference  12,  eq.  4.253  I,  to  get,  after  simplification, 

,k 


NI  ”  C 

A  =  -(1  -  Z  — h—  ^  *  1)3 

k=0 


Then  we  employ  reference  8,  eqs.  6.3.6,  15.1.1,  and  15.3.3  to  develop 

A  =  -(1  -  cf  Z — ^  L 


k=0 


j=0 


k  +  1  +  j 


(D-3) 


”  (N),  C*^  N-2  .  . 

■  -d  -O^E  -4r-  E  / 

j=0  0 


k=0 


k: 


(D-4) 


with  the  latter  step  taken  to  realize  a  product  of  k  and  j  dependence.  Interchanging 
summation  and  integration,  and  performing  the  sums  (reference  8.  eq.  15.1.8),  sve 
obtain 

N-1 


=  -d  -  C)^  f 


dx  (1  -  Cx) 


-N  1  -  X 


1 


(D-5) 


Now  let 


y  = 


1  -  X 


,  X  =  -r-^ - ,  dx  s 

1  +  y  ' 


Jl. 


(I  +  y) 


I  '  Cj  =  1  -  C  ,  (p.6) 


to  get 


D-1 
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00 

1 L 


0 
N-2 


,,  .N-1  N-1 

(1  y)  -  y 
(1  *  c^y)^ 


N-2  A  /■  “  J 

-C^  E  M  f  <iy 
^  j=0  V  J  /  ■'o  (1  +  Cjy)'^ 


.,N  ^  N-1  jU 

1  j^oV  J  / 


N-l\  j  ■'  (N  -  2  -  j )  ! 


,N-l-j 

1 


C:[  "(N  -  1): 


j=0 


N  -  1  -  j 


-  E  T  ■  -,E  i-  -  C)‘  ; 


V  -  -  ^  k 

k=l  "  k=l 


(D-7) 


we  employed  reference  12,  eq.  3.194  3,  to  evaluate  the  integral.  Thus  the  difficult 
integral  in  (D-2)  involving  powers,  a  logarithm,  and  a  hypergeometric  function 
becomes  a  very  simple  polynominal  in  I-C. 


If  we  express  (D-7)  for  OO  as 


n  00  n  00  1 


n=N 


n=N 


we  can  upper-bound  the  bias  (remainder)  in  (D-8)  according  to 


f  -  cE ,  (1_-.C)^  r  ^ 

n-NI  "  "  N  •- 

n=N 


(1  -  C)  (1  -  C)^  +  (1  -  C)^  + 


=  exp(N  ln(l  -  Q)  ^  >  0 

NC  NC 


(D-8) 


(D-9) 


Since  OO,  the  logarithm  in  (D-9)  is  negative,  leading  to  exponential  decay  of  the 
bias  with  N. 


Mean  Square  Value 

To  determine  the  variance  of  the  logarithmic  output,  we  need  to  evaluate,  in 
addition  to  (D-l),  the  mean  square  value  (61): 


(D-10) 


The  expression  for  (D-10)  is  the  obvious  modification  of  (D-2)  obtained  by 
replacing  In  x  by  (In  x)^.  Then  using  reference  12,  eq.  4.261  17,  we  get  (using 
C,  =  l-C) 

"O  (N),  0*^  (  2  ) 

Q  =  c,  E  \  ^  N)  -  t|;(k  ♦  1)]^  >  iJ^'Ck  +  1)  -  .J^'(k  +  N)  } 

^  k=0  '■  ^k  (  ) 

(D-11) 


D-2 
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Now  use  reference  8,  eqs.  6.3.6  and  6.4.6,  to  find 


(N)k  C 


Q  =  C, 

k=0 


'N-2 


N-2 

^  E 


j=0  Ck  +  1  -r  j)2 


(D-12) 


Ai  this  point,  w'e  have  been  unable  to  sum  this  expression  in  closed  form  for 
general  N.  How-ever,  defining 


L  =  -ln(l  -  C)  =  S  i  c'"  . 

n=l 


(D-13) 


we  find  that  we  can  evaluate  the  following  cases  in  closed  form  for  any  C: 
Q  =  ^  2  for  N  =  2  . 


Q  =  c: 


1  3 

C  *  I  -  C 


K‘  -  B 


for  N  =  3  , 


2  6  6 

2*  1  -  C  * 

C  ^  (1  -  C) 


L  /-  1  2 

2^c(  -0^,2 


for  N  =  4  , 


Q  = 


12 


3  1  6  25  20  20 

C^2^3^1-C*  2*  3 

C  C  ^  ^  (1  -  C)  (1  -  C)^ 


forN  =  5 


(D-14) 


Apparently  the  general  solution  to  (D-12)  is  of  the  form 


N-2 

'a  b  ' 

,  N-2  d 

n  n 

+  1  V*  J2. 

n  ^  ^  n 

C  n 

n=l 

Lc"  (1  -  c)  J 

n=0  C 

(D-15) 

However  we  have  not  been  able  to  determine  the  general  dependence  of  the  coef¬ 
ficients  {a„},  {b„},  and  {d„}  on  N;  they  are  independent  of  C,  of  course. 

The  mean  square  value,  Q,  for  C  =  0  and  general  N  follows  immediately  from 
(D-12): 

/n-1  ,V  N-1  , 

forC  =  0. 

\k=l  1^1  (D-'6) 

Combined  with  the  result  for  average  A  in  (D-7),  there  follows  for  the  variance  (65): 


N-1 

V  =  5^  for  C  =  0 
k=l  k"^ 


(D-17) 


D-3 
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An  asympiotic  expansion  for  (D-17)  for  large  N  is  derived  by  using  Watson’s 
lemma  as  follows: 

V  =  E  «t  t  axp(-kt,  -  /“  dt  t 

TT^  f°°  ,  -Nt  t 

~  6  ~  Jq  ®  1  -  exp(-t) 


dt 


e 


-Nt 


as  N  -»■  <»  , 
for  C  =  0  , 


(D-18) 


where  we  used  reference  12,  eq.  3.411  9.  Thus,  whereas  the  variance  of  the 
logarithmic  device  output  tends  to  zero  as  N-*o°  if  C  >  0  (see  (72)),  the  variance 
saturates  at  n^/6  if  C  =  0.  Thus  more  pieces  in  the  MSC  estimate  do  not  lead  to 
smaller  variance  for  the  In  x  transformation  when  C  =  0.  To  compensate  for  this 
feature,  we  have  already  observed  in  (58)  that  the  average  output  gets  arbitrarily 
large  as  N  increases,  when  C  =0.  This  behavior  is  due  to  the  singularity  of  the  In  x 
transformation  at  x  =0. 


D-4 
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Appendix  E 

Modified  Forms  For  Variance 


The  asymptotic  expansion  for  the  variance  of  the  MC  estimate  is  given  by  (68). 
We  rewrite  it  as 


V  = 


(1  -  cy 

2N 


(1  -  C)^ 
8N^  C 


(1  -  C)  +  4C(1  -  3C) 


i]  +  o(n"^) 


(E-1) 


As  explained  in  appendix  C,  the  singular  term  has  a  factor  (1-C)'’  and  would  not 
overly  affect  the  variance  approximation  for  the  larger  C  values  if  it  were  dropped. 
Thus  we  obtain  the  modified  variance  approximation  for  the  MC  estimate  as 


V  i 


(1  -  C)^  (1  -  C)‘  (1  -  3C) 

2X  ■ 


(E.2) 


For  the  arc  tanh  (x'  0  transformation,  we  rewrite  (70)  as 


V  .  4  ■  (»  -  C)-  -,_4C  ,  _ 


(E-3) 


from  which  we  immediately  obtain,  upon  dropping  the  singular  term,  the  modifica¬ 
tion 


;  =  i.  -i- 

-  2N  3„2 


(E-4) 


For  the  v-th  law  device,  we  develop  the  bracketed  term  in  (75)  as 
(1  +  C)^  -  6v(l  +  0(1  -  C)  +  6v^  (1  -  C)^ 

=  (l  -  6v  +  6v^)  (1  -  C)^  +  4C(1  -  3v(l  -  O) 


(E-5) 


Substituting  (E-5)  in  (75)  and  discarding  the  singular  term  (first  term  in  bracket),  we 
obtain  the  modification 


r,  -  2v^(l  -  C)^  4v^(l  -  C)^  (1  -  3v(l  -  O) 


(E-6) 


E-l/E-2 
Reverse  Blank 
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Appendix  F 

Location  of  Peak  of  Probability  Density  Function 


The  probability  density  function  is  given  by  (4).  If  we  use  reference  10,  page  194, 
eq.  8.21.3,  we  find  that 

(1  -  C)^  (1  -  x)^~^  ^ 

U;  ..1/4  ^1/4 .^2N-1 


2C 


1  + 

.  1<N-|)VCX 


as  N  -►  “> 


(F-1) 


In  so  far  as  locating  the  peak  of  (F-1),  we  need  only  concern  ourselves  with  the 
function 


d^(x)  =  a(x)b'^(x) 


L 


(F-2) 


where 

-  ,  _  1  -  ^/cj^  u/-  1  -  1  -  X  re  s  -  (1  -  •<JCx)^ 

a(x)  =  -YU - 2  ’  =  - 7=n  '  - 7=^ 

X  '  (1  -  X)  (1  --J^)  16^iCx 


(F-3) 


The  derivative  of  (F-2)  is  (in  shorthand  notation) 

',Nr,  .  f  1  .,vN-l  r,  f  1  ,.N  f' 

^  ^  L  fTTvI J  "  ^  ^  ^  rT372 J  ^  rT372 


(F-4) 


Setting  d^  =  0,  we  find  we  must  solve  Qf,,  =  0,  where 

ab'  +  N  ja'  b  +  ab'  (f  -  +  j^a'  b^f  -  +  abf' 

(F-5) 

To  highest  order,  we  must  set  either  a  or  b  '  to  zero.  But  from  (F-3),  a(x)#0  in  (0,  1 ). 
Since 


b'  (X) 


^/c7x  -  1 

(1  -^/Oc)^ 


(F-6) 


we  see  that  to  highest  order,  the  peak  of  d^,  occurs  at 


Xj  =  C 


(F-7) 


F-1 
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Now  lo  find  the  correction  term  to  x,  ol'0(N  we  let 


X 


+ 


u 

N 


(F-8) 


in  (F-5),  obtaining 


-  a;  ^)(b;  -  \  -  N[(a;  *  a';  (b^  .  b;  I) 

"  "  ^1  ^  - 1)] " 

-N^a^b;  .  Nj^a'jb^u  .  a// u  .  a'^b^  .  a^b;  (f ^  -  i)j  .  0(1) 

=  N|a^b''u  +  a^b^j  +  0(1)  , 


(F-9) 


and  performing  the  last  step  by  useof  b,'=0.  So,  to  next  liighest  order  in  N,  we  have 
the  correction  ii  in  (F-8)  as 


^1^1  ^  _  a(C)  b(C) 
aj^b"  a(C)  b"(C) 


(F-IO) 


We  find  from  (F-3), 


a(C)  = 


c'/^i  -  C) 


.  a(C)  =  - 


1  -  7C 


4C^'^'^(1  -  C)^ 


1  "  -1 
b(C)  =  ,  b  (C)  = 


1  -  C 


2C(1  -  C) 


3  • 


Substitution  in  (F-10)  yields 


u  =  -  j(l  -  0(1  -  7C) 


(F-11) 


(F-12) 


Combining  this  with  (F-8),  we  find  that  the  location  of  the  peak  of  the  probability 
density  function  of  the  MSC  estimate,  ^  is  at 


(1  -  C)(l  -  7C) 
2N 


(F-13) 


to  0(N  ').  The  perturbation  (F-12)  has  a  maximum  value  at  C  =  4/7  of  value  9/14; 
thus  the  maximum  movement  of  the  peak  is  9/(l4N). 


F-2 
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